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ABSTRACT 


i  1 

Let  F  and  G  be  defined  by  F ( t )  =  H )  and 
G (t )  s  H(et)  where  H  is  unknown  and  H(0)  =  0  . 

For  testing  the  equality  of  the  means  of  F 

and  G  in  the  two-sample  problem;  it  is  shown 

that  the  Savage  (The  Annals  of  Mathematical  Statistics 

(1956)  pp  590-61 5)  statistic  maximizes  the 

minimum  power  over  IFRA(orlFR)  distributions 

asymptotically.  Asymptotic  uniqueness  holds 

only  in  a  class  of  rank  tests.  The  results  are 

extended  to  censored  samples,  the  problem  of 

estimating  the  ratio  of  the  means,  and  the 

k-sample  problem. 


1.  INTRODUCTION  AND  SUMMARY.  Birnbaum,  Esary  and  Marshall  (1966)  have 


shown  that  the  class  u  of  distributions  with  increasing  failure  rate  averages 
( I  FRA)  characterizes  the  concept  of  wear-out  in  the  sense  that  3*"  is  the 
smallest  class  that  contains  the  exponential  distributions  and  is  closed 
under  the  formation  of  coherent  systems. 

In  this  note,  statistical  inference  for  models  in  which  the  distributions 
are  unknown  and  IFRA  will  be  considered.  Let  F  and  G  be  defined  by 

(1.1)  F(t)  =  H(t/0)  and  G (t)  =  H(t/Y) 

where  H  is  an  unknown  IFRA  distribution  with  H(0)  =  0  .  Then,  for  the 
two-sample  problem  where  one  tests  the  equality  of  the  means  of  F  and  G  , 
it  is  shown  that  the  Savage  (1956)  statistic  maximizes  the  minimum  power  over 
IFRA  distributions  asymptotically.  This  asymptotic  minimax  solution  is 
extended  to  censored  samples  and  it  turns  out  that  the  Gastwirth  (1965)  modified 
version  of  the  Savage  statistic  is  asymptotically  minimax  for  this  case. 

Asymptotic  uniqueness  of  these  minimax  solutions  holds  only  in  a  class  of 

rank  tests.  The  results  are  extended  to  obtain  an  estimate  of  the  ratio  of 

the  means  that  minimizes  the  maximum  asymptotic  variance  over  IFRA  distributions. 


Finally,  the  results  are  shown  to  hold  also  for  distributions  with  increasing 
failure  rates  ( I FR) ,  and  extensions  to  the  k  -  sample  problem  are  given. 

2.  THE  TWO-SAMPLE  LIFE -TESTING  PROBLEM.  J . X  and  Y . Y 

— —  -  -  - . .  -  I  m  I  n 

are  independent  random  samples  from  populations  with  life  distributions  F  and 
G  .  N  =  m  +  n  ,  F ( t )  =  H (t/9^)  ,  G(t)  =  H(t/Y^)  ,  H  has  the  density  h  and 
is  IFRA  ,  i.e.,  H(o)  =  0  and  for  each  t  >  0  » 

(2.1)  /t  {  -  109  [l  -  H(t)]  /t  }  =  -'-n  ['~2H(t)]  +  >  0 


r  denote  the  ranks  of  the  x's 
m 


»  •  •  9 


y 


2 


in  the  combined  sample.  The  level  a-  Savage  (1956)  test  ^  of  Hq:  A^ 

against  A^  >  1  rejects  for  large  values  of  the  statistic 

m 

<2-2)  vH 


<vv 


=  1 


"  ln  ^  ■  N+l  ^ 


i=l 


•t  is  assumed  throughout  that 


(2.3)  0  <  lim  (m/N)  =  X  <  1 

N-<ce> 

Let  0  <  c  <  00  and  consider  sequences  of  alternatives  {a^]  satisfying 

(2.4)  lim  ^  (an  -  1)  =  c 

Then  the  asymptotic  power  function  0  (c;cp,H)  of  a  test  9^  is  defined  as  the 
limit  of  the  power  for  such  alternatives,  l.e. 

(2-5)  0  (c;cp,H)  =  lim  inf  (cpj  H) 

N-» 


where  PN(  cp^l  H)  =  E(cpN|FN>GN)  denotes  the  power  of  when  F^(t)  =  H(t/6N), 

GN(t)  =  H(t/yN)  and  A^  **  6N/yN  satisfies  (2.4). 


Let  $  be  the  standard  normal  distribution  function.  Then  the  results  of 
Chernoff  and  Savage  (1958),  Fatou's  Lemma,  and  a  few  computations  yield 


Lemma  2.1.  Suppose  H  has  a  density  h  and  that  H(o)  =  0  ,  then  the 
asymptotic  power  function  of  the  level  a  Savage  test  \|r„  is  given  by 

(2.6)  p(c;*,H)  =  i  (§-'<*)  +  c  [XO-X)]*  J  d  H(tj) 

The  next  result  shows  that  and  the  exponential  distribution 
K^(x)  =  1  -  exp  (-  x/a)  is  a  saddle  point  for  the  asymptotic  power  function 
p(c;*P,H).  In  other  words,  t  is  worst  for  the  exponential  distribtuion, 
but  is  better  than  all  other  tests  for  this  distribution. 
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Theorem  2.1.  For  a  1  1  o  <  c  <  ®  and  a  1 1  a  >  o  , 

(2.7)  sup^  p(c;cp,K^)  =  3 (c;t|r ,K^)  =  infH  p(c;t,H) 

where  H  ranges  over  the  class  of  I  FRA  distribtuions  with  a  density,  and 
cpN  ranges  over  the  class  of  all  level  a  tests . 

Proof.  The  left  hand  equality  was  proved  by  Capon  (1961)  by  essentially 
comparing  t  with  the  Neyman  -  Pearson  test  for  .  To  prove  the  right 
equality,  note  that  (2.1)  yields 

(2.8)  £^|)  >  -  In  [l-H(t)]  , 

thus  00  .  /  V  00 

J  ytHTtT d  H(t)  2  X  -  ,n  <*  H(t)  =  i 

o  o 

The  equality  signs  hold  if  and  only  if  H  has  a  constant  failure  rate 
average,  i .  e . ,  if  and  only  if  H  is  exponential,  thus 

Corollary  2.1.  J_f  H  jjt  I  FRA  ,  has  a  density,  and  is  not  exponent  'al,  then 

(2.9)  p(c;t,K0)  <  p(c;M) 

The  minimax  property  of  the  Savage  statistic  now  follows  at  once  from 
Theorem  2.1. 

Theorem  2.2.  The  level  a  Savage  test  is  asymptotically  minimax 

over  the  class  Q  of  al  1  IFRA  distributions  with  a  density,  i.e.  JHF  H 
ranges  over  Q  ,  then 

(2.1°)  i nf H  p(c;t,H)  >  inf^  p(c;9,H) 

for  al  1  level  a  tests  <pN  . 


Remarks 
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(i)  H  is  said  to  have  increasing  failure  rate  (IFR)  [l  ]  if  H(0)  =  0 
and  h(t)/[l-H(t)]  is  nondecreasing  in  t  >  0  .  The  class  of  IFR 
distributions  contains  the  class  of  exponential  distributions  and  is  contained 
in  the  class  of  IFRA  distributions.  It  follows  that  Theorem  2-1,  Corollary 
2.1  and  Theorem  2.2  holds  also  for  this  class. 

(ii)  The  results  of  this  section  are  stronger  than  the  minimax  results 
of  [6]  in  the  sense  that  no  conditions  such  as  bounds  on  the  Kolmogorov 
distances  or  variances  of  the  distributions  are  needed. 


(iii)  The  lim  inf  in  (2.5)  can  be  replaced  by  a  limit  if  one  assumes 
conditions  as  in  Lemma  3  of  Hodges  and  Lehmann  (1963).  The  results  hold  if 
lim  inf  is  replaced  by  lim  sup  or  partially  replaced  by  lim  sup  as  in  [6]. 


(iv)  An  asymptotically  equivalent  form  of  the  Savage  statistic  is 
(see  [9 ,p.  1127]), 


m 


I  Vrj>  ■ 


(2.11) 


i  =  l 


where 


N 


Vk>  ■  1  7 

j=N-k+l 


(v)  The  results  in  this  section  hold  if  one, instead  of  considering  level 

a  tests, cons iders  cp^  with  asymptotic  level  a  ,  i.e.  tests  for  which 

9  -  y)  —  a  as  N-»». 

(vi)  The  one-sided  alternative  A  >  1  can  be  replaced  by  the  two-sided 


al ternat i ve  i  /  1  . 
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(vii)  For  the  k-sample  problem  with  model  F.(x)  =  H(x/[l  +  0c.  ]);  i  =  l  ,..., 
k;  the  Puri  (1964)  extention  of  the  Savage  statistic  is  asymptotically  minimax 
for  testing  :  0  =  0  against  0  >  0  (or  0  ^  0). 

3.  EFFICIENCY  OF  THE  BEST  TEST  FOR  EXPONENTIAL  MODELS.  When  H  equals 

an  exponential  distribution  K  (t)  =  1-  exp  (-t/a)  ,  then  the  uniformly  most 

o 

powerful  level  cr  test  [7]  9^  of  0  =  Y  against  0  >  Y  rejects  when 


(3.1) 


Y.  >  F 

i 


2m, 2n 


(a) 


where  F-  „  (a)  is  obtained  from  the  tables  of  the  F  distribution.  In  this 
Zm,  zn 

section  the  performance  of  T  is  investigated  when  the  assumption  of  exponent ial  ity 
is  violated  and  H  is  an  I  FRA  distribution. 


Upon  writing 

(3.2)  /N  (T  -  A)  =/N  (K  -  AY)  /  Y  , 


it  is  clear  that  /N  (T  -  a)  has  an  asymptotic  normal  distribution  with  mean 
zero  and  variance 


a2(T)  -  A2  o2(H)  /  \(1-X)  h2(H)  where 


(3.3) 

CD  © 

|x (H)  =  J*  tdH(t)  and  o2(H)  =  J  t  dH (t )  -  \i  (H)  . 
o  o 

2  2 

When  H  is  exponential,  then  a  (H)  =  p,  (h)  .  It  follows  that  when  H  Is 
2  2 

such  that  a  (H)  ?  p4  (H)  ,  then  does  not  have  level  a  asymptotically,  in 
fact 

(3.4)  E(cp*  |  e  =  Y)-*  $  ($_1  (o')  p(H)/a(H))  as  N  -*  ® 


Thus  when  &  <  j  and  p(H)  >  <j(H)  ,  then  the  asymptotic  level  of  cp’J 


is  less 
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than  a  .  Barlow,  Marshall  and  Proschan  (1963)  have  essentially  shown  that 
for  IFRA  distributions,  p. (H)  >  o(H)  .  The  asymptotic  power  function  of  9^  is 

(3.5)  g(c;<P*  .  H)  =  *({*■'(«)  +  c[X(!JL)A  h(H)/o(H)) 

* 

^  can  easily  be  modified  to  have  asymptotic  level  a  by  dividing 

/N  (T-l)  by  a  consistent  estimate  of 
r (H)  =  a(H)/p(H);  e.g. 
r(H)  =  a(H)/|l(H)  with 
p(H)  =  ^  (S  Xj  +  £  y.)  and 

I  5(H)  =  J  (i:  xj  +  E  yj)  -  |x2(H)  . 

| 

For  this  test,  ,  one  has 

(3.6)  fl(c;$,H)  =  +  c[X(l -Xl2p(H)/a(H)) 

Since  p(H)  >  a(H)  [l]  when  H  is  IFRA,  p-(k^)  =  cy(k^)  »  ar>d  since  |3(c;t*ka)  = 

P(c,<P,k  ),  then  (2.7)  and  remark  (i)  of  Section  2  yields 
a 

Theorem  3.1.  For  a  1 1  o  <  c  <  ®  and  all  a  >  o  , 

f 

(3-7)  sup^  0(c;<p,ka)  =  3(c;$,ka)  =  infH  3(c,$,H) 

where  H  ranges  over  the  class  of  IFRA  distributions  and  9^  ranges  over 
the  class  of  all  tests  with  asymptotic  level  a  . 

Thus  is  asymptotically  minimax  in  the  sense  of  Theorem  2.2  for  the  class 

of  IFRA  distributions  and  the  class  of  tests  with  asypmtotic  level  <y  .  To  see 
that  this  is  not  true  for  ,  let  H  be  an  IFRA  distribution  with  p(H)  >  o(H)  , 
tl  ^n  for  each  a  <  2  » 

(3.8)  P(c;cp*,H)  <  P(c;9,ka)  for  0  <  c  <  a(H)/p(H)  . 
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Let  Pitman  asymptotic  efficiency  be  as  defined  in  [10]  .  It  follows  from 


(2.6)  and  (3.6)  that  the  Pitman  efficiency  of  the  Savage  test  i|r^  to  the 

A 

modified  classical  test  is 


(3.9) 


e(i|f,<J)  = 


00 

f 

2 

°2(h) 

•h  xq(x)dH(x)  . 

h2(h) 


where  q(x)  ~  h(x)/[l -H(x) ]  is  the  failure  rate  of  H  . 


The  Weibull  distribution  is  defined  by 

b 


(3.10) 


H(x)  =  1  -e"3X  ;  a  ,b  >  0;  x  >  0 


If  denotes  the  kth  moment  about  zero,  then 


(3.11) 


k  =  a  b  r  (£  +  1),  q(x)  =  ab  xb-1  , 
00  • 

and  S  xq(x)dH(x)  *  ab  =  b 


Thus  for  the  Weibull  distribution 

i2 


(3.12) 


efa(t,<p) 


[  r  (t  *  ')  -  r2  (e~  +  ')] 

t2(f  +  ') 


For  b  =  1,  the  Weibull  distribution  coinsides  with  exponential  distribution 

A 

and  e^(\(f,9)  =  1  .  For  b  =  2,  one  has  the  linear  failure  rate  q(x)  =  2ax  and 
(3.12)  becomes 


e2r*,$)  «  —  -  i  1.093 


(3.13) 


(3.17)  e,U,<p)  >  1  for  all  b  >  0 

and  for  all  test  for  which  this  efficiency  is  computable.  In  particular 

(3.17)  holds  for  9^  .  Thus  the  Savage  test  i|r^  is  uniformly  more  efficient 

A 

than  the  adjusted  classical  test  9^  for  the  Weibull  distribution.  Moreover, 
the  Savage  test  is  much  better  when  the  failure  rate  parameter  b  is  large  or 
close  to  zero.  It  is  conjectured  that  the  Savage  statistic  is  uniformly  more 

A 

efficient  than  9.,  for  all  distributions  with  monotone  failure  rates. 

N 
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4.  CENSORED  SAMPLES.  Fix  M  <  N  and  wait  until  a  total  of  M  X's  and  Y's 
have  failed.  Let  m'  <  rn  be  the  number  of  z's  observed,  then  the  ranks 
rj,...,rm,  can  be  computed  from  the  data.  The  Gastwirth  (1965)  modified  Savage 
statistic  is  m* 


(4.1) 


It  is  assumed  that 


(4.2)  o  <  lim  (M/N)  =  p  <  1 

ff*D 

The  asymptotic  power  function  of  the  level  a  test  ^  that  rejects  for  large 
values  of  S^  can  be  computed  using  [9]  and  [8]  .  One  gets 

(4.3)  B(e;+p.H)  =  «(*"'(«)  +  c[A(l-X)/p]*  /  (P>  dH(t)) 

From  (2.8),  it  follows  that  when  H  ranges  over  the  class  of  IFRA  distributions, 
then 


(4.4) 


infH  P(c;*p,H)  =  &(c;f  ,Ka) 

=  +  c[X(l  -\)/p]?  [p+1  n(l  -p)  (l  -p)  ]  ) 


Since  Hajek  (1962)  and  Gastwirth  ( 1 965 )  has  shown  that 


(4.5)  Bfcj+p.K^)  >  B(c;<P,Ko) 

for  all  level  <y  tests  cp..  ,  then  the  results  of  Section  2  holds  for  ii’  . 

N  n 

5.  ASYMPTOTIC  UNIQUENESS.  Stein  (1956)  and  Hajek  (1962)  has  shown  that 
one  can  obtain  asymptotically  optimal  statistics  by  estimating  the  underlying 
distribution.  Although  these  statistics  are  impractical,  they  show  that  one 
can  not  hope  for  asymptotic  uniqueness  in  the  class  of  all  tests  with  asymptotic 
level  a  • 
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Consider  the  class  of  one-sided  level  a  rank  tests  cT  [5]  based  on 
statistics  of  the  form 

m 

TM  =  W  =  m  T  Jn(n+t) 

i  =  l 

where  there  exist  a  function  J  which  is  continuous  except  for  possibly  a  finite 

number  of  jump  discontinuities  and  which  satisfies 

1  ?  1  , 

(5.2)  J  J  (u)du  <  00  and  1  im^_^  J  [J^(u)-J(u)j  du  =  0 

o  o  ! 

and  the  conditions  of  Comment  3*8  of  Hajek  ( 1 962 ) .  Let  5-  be  the  class  of 
I  FRA  distributions  H  with  a  density  h  which  has  the  Radon  -  Nykodim 
derivative  h'  with  respect  to  Lebesque  measure  and  satisfies 


(5.3) 


J  [x^h1  (x)/h(x) ]2  dH(x)  <  08 


For  these  classes  one  has 


Theorem  5«2. 
minimax  for  cT  and 
and  i  f 


The  Savage  -  Gastwirth  test  ♦  is  asymptotically  uniquely 
.  i.e.,  if  <P  =tp  (Ji.)eeT,  if  H  ranqes  over  5"  , 

O  ON  . . .  . . .  ■— 


(5-4)  infH  3(c;cP0>H)  >  infH  p(c;<P,H) 

for  all  9  e  cT,  then  there  exists  constants  a^  and  such  that 

(5.5)  /N  [SM  -  (aNTM(JN)  +  bM)]-  0 

i n  probab i  1  i ty  as  N  *-»  ®  provided  (2.3)»(4.2)  and  (2.4)  hold  with  c  <  00  . 


Proof.  (2.7)  and  (5-4)  show  that  3(c;9o,iO  =  3(c^p»Ka) •  Thus 

is  asymptotically  optimal  for  K  .  From  Hajek  (19&2),  it  follows  that  the 

o 

correlation  coefficient  satisfies 


PN(SMJM  I  Ko;A  =  "  1  as  N  “  “ 


(5.6) 
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This  implies  that  for  regression  coefficients  a^  and  b^  , 

(5.7)  E(N[SM-(aNTM+bM))2  |  Ka;A=l)  -  0 

Since  and  are  distribution  free,  (5-7)  holds  not  only  for  k^,  but 

for  general  H  .  The  result  now  follows  from  the  contiquity  arguments  of 
LeCam  and  Hajek  (e.g.,  [9]). 


6.  ESTIMATION.  Barlow  and  Prochan  (1966)  have  shown  that  the  estimates 
of  the  mean  that  are  optimal  for  exponential  models  are  not  robust  for  IFR 
distributions.  Here  an  asymptotically  robust  estimate  of  the  ratio  p,j /p,^  of 
the  means  of  X  and  Y  is  constructed  using  the  methods  of  Hodges  and 
Lehmann  (1963).  Write  x  =  (xj,...,xJ,y  =  (yj,...»y  )  *  ax  =  (axj,...,ax  ) 
etc.,  and  let 

(6.1)  s(x,y)  =  SM 


be  the  Savage  -  Gastwirth  statistic  (4.1).  p^/p^  =  0p.(H)/ypL (H)  =  0/y  =  A  ,  so 

one  estimates  A  • 

Note  that  /N  s  (X  ,  AY)  asymptotically  tends  to  be  normally  distributed 
aboJt  the  point  0  [9]  .  Let 


(6.2) 

and  define  the  estimate 


A*  =  sup  {A:  s(x,Ay)  >0}  and 
A **  =  inf  [A:  s(x^y)  <  0} 

A 

A  of  A  by 


(6.3) 


A  =  A(x,y)  =  i(A*  +  A**) 


Since  s(ax,ay)  =  s(x,y)  by  the  invariance  properties  of  ranks,  then 

A  A  A 

(6.4)  A  (ax, ay)  =  A  (x,y)  for  all  a  >  0  ,  i.e.,  A  is  scale 

i  nva  riant. 
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Moreover,  using  this,  the  definition  (6.2),  and  noting  that  s(x,Ay)  is 
decreasing  in  A  ,  one  gets 

(6.5)  A  (ax, by)  =  (a/b)  £  (x,y)  , 

(6.6)  PA(£/A  <  t)  =  PjGS  <  t)  , 

(6.7)  A*  <  A**  1 

(6.8)  P (a*  <  t)  =  P(s(x,ty)  <  0)  , 

(6.9)  P (A**  <  t)  =  P(s(x,ty)  <  0)  , 

(6.10)  P(s(x,ty)  <  0)  <  P(£  <  t)  <  P(s(x,ty)  <  0)  ,  and 


Lemma  6.1.  If  H  sat isf ies  (5«3)  and  H(0)  =  0,  then 


limN^,PA(/N  f(A/A)-  1]  <  t) 


Proof.  (6.6)  shows  that  one  can  let  A  =  1 •  Prom  (6.10)  it  follows  that 


lirV~>Pl(N^  "  0  <  t)  =  lirn^fi  <  1  +  tN‘2) 
c  liV*ooPl(s(X,(l  +  <  °) 

=  1  irV*»PA  (S(X»Y)  5  °) 

where  AN  =  1/(1  +  tN"2)  .  Since  N^(a^  -  1 )  -*  t  as  N  -♦  »  ,  the  result 
follows  from  (4.3). 


Lemma  6.1  shows  that  the  asymptotic  variance  of  /N  [(a/A)  -  1]  is 

(6.1!) 


1  H''(p)  th/t1 

v(i.H)  =  i/[xo-x)/p]J  j  r-~H(-ty dH(t)  • 


Moreover,  (4.4)  shows  that  the  maximum  asymptotic  variance  over  I  FRA  distribut 


ions 


s 
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(6.12)  supHV(fi,H)  =  V(£,  Ka)  =  l/[X(l-X)/p]2[p  +  ln(l-p)(l-p)] 

» 

Let  be  as  in  Section  5»  then  the  results  of  the  previous  sections 

y  iel  d 

Theorem  6.1.  A  is  asymptotically  minimax  over  and  the  class  £ 
of  scale  invariant  estimates  that  are  asymptotically  normal;  i.e.,  if 

<v 

V(A,H)  denotes  the  asymptotic  variance  of  the  estimate  A  e  £  ,  then 

(6.13)  supH  (V(A,H):  H  e  JO  <  supH  (V(a,H):  H) 

V(A,H)  also  satisfies  the  saddle-point  inequality 

(6. 1*0  suPhV(A,H)  =  V(a,K  )  =  inf-  V(a ,K  ) 
n  a  A  a 

where  H  ranges  over  and  A  over  &  . 

A  different  approach  to  the  problem  of  obtaining  asymptotic  minimax 
estimates  is  given  by  Huber  (1963). 
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